Papers by Karin de Langis
Strong Memory, Weak Control: An Empirical Study of Executive Functioning in LLMs (2026.eacl-long)
Copied to clipboard
Karin de Langis, Jong Inn Park, Bin Hu, Khanh Chi Le, Andreas Schramm, Michael C. Mensink, Andrew Elfenbein, Dongyeop Kang
| Challenge: | Working memory is a critical component of human intelligence and executive functioning . it is correlated with performance on various cognitive tasks, including fluid intelligence . |
| Approach: | They apply working memory tasks to large language models to estimate working memory capacity . they find that LLMs exceed normative human scores, but not executive functioning benchmarks . |
| Outcome: | The proposed models do not show higher performance on executive functioning tasks or problem solving benchmarks. |
infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-information (2023.acl-long)
Copied to clipboard
| Challenge: | Several methods for characterizing datasets based on model-driven meta-information have been developed, but the relationship and complementary effects of these methods have received less attention. |
| Approach: | They propose a framework that captures multidimensional characteristics of datasets by incorporating various model-driven meta-information. |
| Outcome: | The proposed framework outperforms baselines in three real-world applications and can be used in a variety of real-time problems. |